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INTRODU CTION :  The  visitor  comment  card  was  developed  in  the  mid- 1 990’s  for  use  by 

project  managers  in  assessing  satisfaction  levels  of  recreation  visitors  to  Corps  of  Engineer 
managed  recreation  areas.  Since  the  introduction  of  the  comment  card,  customer  satisfaction 
surveys  have  been  routinely  conducted  at  many  Corps  of  Engineers  water  resources  development 
projects.  Results  of  these  surveys  have  provided  managers  with  ongoing  visitor  feedback 
regarding  the  recreation  facilities,  services,  and  information  available  on  their  individual 
project(s).  The  high  value  that  managers  place  on  monitoring  customer  feedback  is  indicated  in 
a  survey  of  project  managers  indicating  that  customer  satisfaction  data  was  the  most  useful 
information  managers  had  available  for  guiding  recreation  management  decisions  (U.S.  Army 
Corps  of  Engineers  2003). 

While  the  original  intent  of  the  comment  card  was  to  provide  managers  with  a  tool  for  use  on 
their  own  projects,  there  has  been  considerable  interest  in  using  existing  comment  card  data  to 
compare  customer  satisfaction  results  between  projects  and  to  characterize  visitor  satisfaction 
across  Districts,  Divisions,  and  the  entire  Corps  recreation  program.  To  meet  reporting  needs,  it 
has  become  frequent  practice  to  roll  up  customer  satisfaction  data  originally  obtained  by  projects 
for  their  own  use  to  higher  reporting  levels.  Although  this  practice  is  widespread,  there  are 
concerns  that  different  visitor  populations  and  methods  of  data  collection  at  different  projects 
may  produce  inconsistent  results. 

Visitor  satisfaction  is  a  performance  measure  of  the  Corps  Recreation  Business  Area.  The  Corps 
measures  and  reports  customer  satisfaction  results  to  the  Office  of  Management  and  Budget 
(0MB)  to  meet  requirements  set  forth  under  the  Government  Performance  and  Results  Act 
(GPRA).  As  performance  results  come  to  play  an  increasingly  larger  role  in  oversight  of  the 
Corps  Recreation  Business  Area,  it  is  becoming  correspondingly  more  important  that 
performance  measurements  produce  accurate  and  consistent  results.  Up  to  now,  the  only 
customer  satisfaction  data  available  for  producing  ainational  estimate  were  compiled  from  the 
results  for  projects  that  volunteered  data  collected  by  varying  and  largely  unknown  methods. 

This  survey  addressed  the  need  for  consistent  data  for  measuring  Corps  visitor  satisfaction  at  the 
national  level. 

PURPOSE:  This  paper  presents  results  of  a  pilot  national  satisfaction  survey  of  visitors  to 
Corps-managed  recreation  areas.  The  survey  was  based  on  a  sampling  protocol  capable  of 
producing  a  national  estimate  of  customer  satisfaction  and  on  standardized  data  collection 
methods  ensuring  consistency  across  recreation  areas  and  projects.  The  survey  data  were  used  to 
1)  produce  a  national  estimate  of  customer  satisfaction,  2)  provide  preliminary  data  for 
benchmarking  Corps-managed  recreation  areas,  and  3)  evaluate  the  suitability  of  the  survey 
protocol  for  monitoring  visitor  satisfaction  in  the  Corps’  Recreation  Business  Area. 
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METHODS:  This  survey  used  project  personnel  to  administer  the  comment  card  to  a  sample  of 
day-use  and  camping  visitors.  Standardized  field  procedures  and  a  calendar  of  sample  dates  and 
locations  were  developed  and  distributed  to  the  projects  as  guides  for  data  collection.  After 
obtaining  the  required  data  from  visitors,  project  personnel  entered  the  data  into  a  standardized 
reporting  system  and  at  the  end  of  the  survey,  provided  final  data  for  the  project  to  the  authors. 
Data  were  collected  from  July  1  through  September  1, 2002. 


The  current  version  of  the  comment  card  (Figure  1)  has  been  used  to  collect  satisfaction  data 
from  Corps  recreation  visitors  since  1999,  so  most  projects  (including  all  of  those  participating 
in  this  survey)  had  considerable  prior  experience  with  its  use.  In  this  survey,  data  collection 
efforts  at  all  participating  projects  were  either  supervised  or  conducted  by  the  ranger  with 
primary  responsibility  for  customer  satisfaction  surveys. 


Comment  Card 


OMB  0710-0001 


US  Army  Corps  Please  give  us  a  minute  of  your  time  to  help  us  sen>e  you  better. 

of  Engineers 


What  is  the  primary  purpose  of  your  visit  today? 

Please\7\one  box:  Campmg{2  Boating  D  DayUse  D 

Horne  Zipcode 

//OMf  would  you  rate  our  facilities  and  services  at . 


Please  ^^ne  box  for  each: 


Safety  and  security  at  the  recreation  area 
Appearance  and  maintenance  of  the  area 
Restroom  cleanliness 

Availability  of  staff  to  answer  my  questions 
Adequate  ranger/visitor  assistance  patrols 
Current  and  accurate  information 
Water  safety  Information 
Value  for  fee  paid 


Very 

Good 

□ 
□ 
□ 
□ 
□ 
□ 
□ 
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Good 

□ 

□ 

□ 

□ 

□ 

□ 

□  : 
□ 


Average 

□ 

□ 

□ 

-  □ 

□ 

□ 

□ _ 


Poor 

□ 

□ 

n 

□ 

□ 

□ 

□ 


Very 

Poor 

^:  0  : 

□ 

□ 

□ 

:  □ 

□ 


Don’t 

Know 

□ 

□ 

□ 

□ 


Overall  quality  of  facilities  and  services  D  Q 

What  improvements  would  you  like  to  see  in  this  area?  — 


□ 


□ 


□ 


Figure  1 .  Customer  comment  card:  survey  instrument  used  in  the  2002  national  customer  satisfaction 
survey  of  Corps  recreation  visitors 


Visitors  were  selected  to  receive  the  survey  as  part  of  a  four-stage  selection  process  in  which 
selection  probabilities  were  approximately  known  but  were  unequal.  The  first  three  stages  of 
selection  identified  the  projects,  recreation  areas,  and  dates  on  which  sampling  would  occur.  A 
calendar  of  the  sampling  schedule  (Appendix  A)  was  then  produced  and  distributed  to  each 
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participating  project  before  sampling  was  scheduled  to  begin.  The  fourth  stage  of  sample 
selection  involved  the  identification  of  visitors  to  survey  on  the  recreation  area  on  a  given  date. 
For  this  purpose,  standardized  rules  for  administering  the  survey  to  individuals  on  designated 
sample  dates  were  provided  to  each  participating  project  (Appendix  B). 

As  the  study  was  planned,  a  total  sample  of  2,400  visitors  was  selected  in  four  stages.  In  the  first 
stage,  20  projects  were  selected  from  456  Corps  projects  with  probability  proportional  to  1999 
project  visitation.  Next,  three  recreation  areas  were  selected  at  each  of  these  projects  with 
probability  proportional  to  area  visitation.  Five  sampling  days  were  then  selected  for  each 
recreation  area  with  probability  proportional  to  average  daily  visitation.  Finally,  a  fixed  sample 
of  eight  visitors  was  chosen  on  each  sample  date.  This  selection  procedure,  commonly  referred 
to  as  probability-proportional-to-size  (PPS)  sampling,  produced  a  sample  for  which  each 
recreation  visit  associated  with  any  of  the  456  Corps  projects  had  approximately  the  same  overall 
chance  of  being  included  in  the  survey. 

A  project’s  participation  in  the  study  was  voluntary.  Of  the  initial  20  projects  that  were  asked  to 
participate  in  data  collection,  6  were  unable  to  do  so  for  various  reasons.  Therefore,  additional 
project  selections  were  made,  again  with  probability  proportional  to  visitation,  until  20  projects 
had  agreed  to  participate  in  the  survey  (Table  1). 

RESULTS  AND  DISCUSSION:  A  total  of  2,123  completed  customer  satisfaction  surveys 
were  obtained  from  19  of  the  20  projects  that  agreed  to  collect  and  provide  data  for  this  survey. 
One  project  was  unable  to  complete  data  collection  due  to  staff  illness.  Of  visitors  who  were 
asked  to  complete  the  comment  card,  only  seven  declined  to  do  so,  resulting  in  an  overall 
response  rate  of  99.7  percent.  The  extraordinarily  high  response  rate  was  probably  influenced  by 
a  feature  of  the  data  collection  protocol  in  which  rangers  hand-delivered  comment  cards  to 
visitors  selected  to  participate  in  the  sample  and  then  waited  to  obtain  responses  from  them. 

Customer  Satisfaction  Scores.  Of  survey  respondents,  74  to  90  percent  rated  nine 
performance  items  as  either  “good”  (4)  or  “very  good”  (5)  on  a  5-point  rating  scale  (Table  2). 

The  percentage  of  visitors  rating  performance  as  “good”  or  “very  good”  was  highest  for  value  for 
fee  paid  (90  percent),  followed  by  appearance  and  maintenance  of  the  area  (89  percent),  safety 
and  security  at  the  recreation  area  (88  percent),  current  and  accurate  information  (84  percent), 
water  safety  information  (8 1  percent),  adequate  ranger  /  visitor  assistance  patrols  (79  percent), 
availability  of  staff  to  answer  my  questions  (75  percent),  and  restroom  cleanliness  (74  percent). 
Ninety  percent  of  respondents  rated  the  overall  quality  of  facilities  and  services  as  “good”  or 
“very  good.” 

Satisfaction  levels  reported  by  recreation  visitors  in  this  survey  were  broadly  similar  to  those 
reported  by  Titre  et  al.  (1997)  for  a  collection  of  24  Corps  recreation  areas.  In  that  survey, 

74-93  percent  of  visitors  rated  nine  performance  items  as  either  “good”  or  very  good.”  Direct 
comparison  of  the  results  between  Titre  et  al.  (1997)  and  the  present  survey  are  somewhat 
hindered  by  differences  in  survey  instruments.  While  the  two  surveys  addressed  similar 
performance  items,  only  three  of  the  nine  rating  items  were  identical  in  both  content  and 
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Table  1 

Projects  Selected  for  Participation  in  the  2002  National  Customer  Satisfaction  Survey 
(Projects  that  agreed  to  participate  in  the  survey  are  noted  in  bold  type) 


Order  of 


Agreed  to 


Selection 

_ 

_2 _ 

_J _ 

_4 _ 

_5 _ 

_ 

_ 

_J _ 

_9 _ 

JO _ 

J1 _ 

12 _ 

J3 _ 

14 _ 

J5 _ 

J6 _ 

J7 _ 

J8 _ 

J9 _ 

^0 _ 

21 _ 

22 _ 

23  _ 

24  _ 

25  _ 

26  _ 

27 


Participate 

Yes 

Yes _ 

Yes _ 

Yes _ 

J^o _ 

Yes _ 

Yes 

Yes _ 

Yes _ 

JviO _ 

Yes _ 

Yes 

Yes _ 

Yes _ 

No _ 

Yes _ 

No _ 

No _ 

No _ 

Yes _ 

Yes _ 

Yes 

Yes _ 

Yes _ 

No _ 

Yes _ 

Yes  _ 


Division 

NWP 

LRD 

SWD 

SWD 

SPD 

LRD 

NAD 

SWD 

SWD 

SWD 

SWD 

SAD 

NWP 

SAD 

LRD 

SAD 

LRD 

NAD 

SAD 

MVP 

LRD 

SWD 

MVP 

MVP 

MVP 

SAD 

NWD 


District 

WALLA  WALLA 
NASHVILLE 

TULSA _ 

FORT  WORTH 
ALBUQUERQUE 
NASHVILLE 
NEW  ENGLAND 
LITTLE  ROCK 
LITTLE  ROCK 
LITTLE  ROCK 
FORT  WORTH 

MOBILE _ 

KANSAS  CITY 

MOBILE _ 

LOUISVILLE 

MOBILE _ 

HUNTINGTON 
NEW  ENGLAND 
WILMINGTON 
ST.  LOUIS 
NASHVILLE 
FORT  WORTH 
ST.  LOUIS 
ST.  PAUL 
ST.  LOUIS 

MOBILE _ 

KANSAS  CITY 


'  Unable  to  complete  data  collection  due  to  staff  illness. 


State 

WA 

TO _ 

OK 

TX _ 

CO 

TN _ 

MA 

AR 

AR 

AR 

TX 

GA 

KS 

GA 

KY 

GA 

OH 

CT 

NC 

JL _ 

TN _ 

TX _ 

JL _ 

ND 

MO 

FL _ 

KS 


1999  Visits 


Project 


(in  millions) 


MCNARY  LOCK  &  PAM,  LAKE  WALLULA 
J  PERCY  PRIEST  DAM  AND  RESERVOIR 


4.2 

6.6 


OOLOGAH  LAKE _ 

HORPS  CREEK  LAKE _ 

JOHN  MARTIN  DAM _ 

DALE  HOLLOW  LAKE^ _ 

CAPE  COD  CANAL _ 

BEAVER  LAKE _ _ 

DARDANELLE  LAKE  >  ARK.RIV.NAV.SYS 

GREERS  FERRY  LAKE _ 

SAM  RAYBURN  RESERVOIR _ 

ALLATOONA  LAKE _ 

WILSON  LAKE _ 

WALTER  F.  GEORGE  LAKE _ 

MCALPINE  LOCK  AND  DAM  +OHIO  RIVER 

LAKE  SIDNEY  LANIER _ 

MOHAWK  DAM _ 

WEST  THOMPSON  LAKE _ 

B  EVERETT  JORDAN  DAM  AND  LAKE 

CARLYLE  LAKE _ _ 

OLD  HICKORY  LOCK  AND  DAM _ 

STILLHOUSE  HOLLOW  RESERVOIR 
LAKE  SHELBYVILLE _ _ 


1.3 
0.5 
0.3 

3.4 

3.8 

2.4 
2 

5.6 

1.6 

5.7 
0.2 
6.6 
0.3 

7.7 
0.3 
0.1 
1.2 

2.9 

11.9 
0.4 

2.5 


BALDHILL  PAM  LAKE  ASHTABULA 


0.2 


WAPPAPELLO  LAKE 

LAKE  SEMINOLE 
MILFORD  LAKE 


2.1 

1 

0.5 


Table  2 

Summary  of  Responses  of  Corps  Project  Visitors  to  the  2002  National  Customer 
Satisfaction  Survey  _  _ _ 

I  I  Response  Distribution  (Percent) 


Customer  Satisfaction  Item 


No.  of  Visitor  Very 
Responses  Good 


Good 


Average 


Poor 


Very 

Poor 


Total 


1 


Safety  and  security  at  the  recreation  area 
Appearance  and  maintenance  of  the  area 

Restroom  cleanliness _ 

Availability  of  staff  to  answer  my  questions 
Adequate  ranger/visitor  assistance  patrols 

Current  and  accurate  information _ 

Water  safety  Information _ 

Value  for  fee  paid _ 

Overall  quality  of  facilities  and  services 


2092 

2105 

1746 

1921 

2063 

1877 

1758 

1872 

2039 


44 

54 

44 


44 

ii 

41 

ii 

ii 

il 

IL 

46 


J£ 

12. 

ii 

ii 

J7 

9 


J_ 

J_ 

_5 

_4 

J_ 

2^ 

1 


1 


J_ 

1 

J_ 

J_ 

0_ 

J_ 

1 


0 


100 

100 

100 

100 

100 

100 

100 

100 

100 
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wording.  Of  these,  restroom  cleanliness  was  the  lowest  rated  item  in  both  surveys,  with  the  same 
percentage  of  visitors  (74  percent)  rating  this  item  “good”  or  “very  good.”  Overall  quality  of 
facilities  and  services  was  similar  in  the  present  survey  (90  percent)  and  the  earlier  survey 
(87  percent),  while  value  for  fee  paid  was  rated  higher  by  visitors  in  the  present  survey 
(90  percent)  than  in  the  earlier  survey  (81  percent).  Other  response  differences  were  also 
apparent  in  the  two  surveys.  For  example,  the  availability  of  staff  to  answer  questions  was  rated 
“good”  or  “very  good”  by  75  percent  of  respondents  in  the  current  survey,  while  93  percent  of 
respondents  in  the  earlier  survey  gave  these  scores  to  a  similar  item,  staff  helpfulness.  Different 
ratings  given  to  similar,  but  not  identical,  performance  items  underscores  the  need  for  a 
consistent  survey  instrument  as  well  as  standardized  and  consistent  survey  methods  so  that  any 
performance  changes  over  time  are  not  confounded  with  methodological  differences  between 
surveys  conducted  at  different  locations  or  in  different  years. 

Comparison  of  Corps  with  NFS  and  USFS.  The  National  Park  Service  (NPS)  and  the 
U.S.  Forest  Service  (USFS)  both  collect  customer  satisfaction  data  from  their  visitors  using  the 
same  five-point  rating  scale  currently  used  in  the  Corps  comment  card.  The  NPS  has  released 
national  visitor  satisfaction  results  for  the  years  1988-2001.  In  their  most  recent  survey  (2001), 
72-96  percent  of  NPS  visitors  gave  15  performance  items  a  rating  of  “good”  or  “very  good” 
(University  of  Idaho,  undated).  Visitor  satisfaction  scores  in  the  NPS  survey  were  similar,  but 
often  slightly  higher  than  those  obtained  in  the  present  survey  of  Corps  visitors. 

The  USFS  has  released  national  results  for  2002  from  customer  satisfaction  data  collected  as  part 
of  its  recently  revised  visitation  survey  methodology.  The  USFS  survey  instrument  uses  the 
same  5-point  rating  scale  as  used  in  both  the  Corps  and  NPS  instruments.  In  the  2002  survey, 
65-99  percent  of  USFS  visitors  gave  14  customer  satisfaction  items  a  rating  of  “good”  or  “very 
good”  (USDA  Forest  Service  2002).  Visitor  satisfaction  scores  in  the  USFS  were  typically 
several  percentage  points  lower  than  scores  obtained  in  the  Corps  for  similar  performance  items. 

Visitor  Expectations.  While  the  USFS,  NPS,  and  Corps  ask  visitors  to  assess  satisfaetion 
with  their  recreation  experienee,  the  USFS  asks  visitors  to  also  rate  the  importance  of  the  same 
rating  items  to  their  recreation  experience.  With  this  additional  information,  the  USFS  was  able 
to  determine  whieh  performance  items  were  most  important  to  visitors  and  to  evaluate  agency 
performance  against  visitor  expectations.  While  Corps  comment  card  surveys  address  only  the 
satisfaction  dimension,  another  survey  of  Corps  recreation  visitors  addresses  both  the  importance 
and  performance  dimensions.  The  American  Customer  Satisfaction  Index  (ACSI)  survey 
conducted  by  the  University  of  Michigan  addressed  the  broader  issues  in  its  2001  and  2002 
surveys  of  Corps  recreation  visitors  (ASCI,  undated).  Unpublished  results  from  the  ASCI  show 
that  Corps  performance  has  generally  exceeded  the  expectation  of  its  recreation  visitors.  The 
ACSI  results  also  showed  that  project  lands  and  waters  eontribute  more  to  visitor  satisfaetion 
than  do  the  facilities,  services,  and  information  available  on  Corps  projects.  This  is  a  dimension 
of  satisfaction  that  is  not  addressed  in  the  comment  card. 

Benchmarking  Corps  Business  Area  with  ACSI.  The  ASCI  is  designed  to  facilitate 
comparison  of  customer  satisfaction  results  among  public  and  private  service  providers.  The 
Corps  has  typically  scored  near  the  middle  in  customer  satisfaction  among  federal  recreation 
providers  who  participated  in  the  ASCI  survey  between  1999  and  2001.  In  the  2001  survey,  the 
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ASCI  for  Corps  recreation  visitors  (71)  was  comparable  to  the  ASCI  for  private  companies 
(71.3)  and  higher  than  the  mean  ASCI  for  the  Federal  Government  as  a  whole  (68.6)  (ASCI, 
undated).  In  addition,  component  results  from  the  2001  survey  showed  that  the  Corps  recreation 
program  had  a  high  level  of  visitor  trust  (79)  and  received  a  very  low  level  of  complaints 
(1.1  percent)  compared  to  other  federal  agencies  that  participated  in  the  survey. 

Component  satisfaction  indicators  from  the  2001  ACSI  survey  tend  to  agree  with  satisfaction 
results  of  the  present  survey.  In  both  surveys,  the  Corps  received  higher  scores  for  the 
appearance  of  recreation  areas,  moderate  scores  for  visitor  information,  and  lower  scores  for 
visitor  facilities  and  services.  Results  from  the  present  survey  tend  to  support  an  ACSI  finding 
that  the  ability  to  deliver  visitor  services  (typically  by  rangers)  is  one  of  the  weaker  aspects  of 
the  Corps  business  area.  In  the  current  management  environment,  improving  ranger  services  to 
the  visitor  would  be  difficult  to  achieve  given  the  adverse  staffing  trends  and  the  increasing 
amount  of  time  rangers  are  spending  on  office-related  duties  (U.S.  Army  Corps  of  Engineers 
2003). 

Benchmarking  Corps  Recreation  Projects  and  Recreation  Areas.  All  of  the 

recreation  areas  included  in  this  survey  had  mean  satisfaction  scores  of  “average”  (3.0)  or  above 
on  each  of  the  nine  performance  items  (Figure  2).  However,  mean  scores  tended  to  vary  widely 
from  the  middle  (3.2)  to  near  the  top  (4.8)  of  the  satisfaction  scale.  Recreation  areas  receiving 
the  top  scores  are  potential  “best-in-class”  areas  from  a  visitor  viewpoint.  Studying  the 
facilities,  services,  and  other  characteristics  of  best-in-class  recreation  areas  can  provide  insights 
into  the  kinds  of  improvements  that  are  most  likely  to  improve  visitor  satisfaction  of  lower 
performing  recreation  areas. 


3  3.2  3.4  3,6  3.8  4  4.2  4.4  4.6  4.8  i 

y 

Safety  and  seeurity  atthe  recreation  area 

Appearance  and  maintenance  of  die  area 

Restroom  cleanliness 

Availabilityof  staff  to  answer  my  questions 

Adequate  ranger/visitor  assistance  patrols 

Current  and  accurate  information 

Water  and  safety  information 

Value  for  fee  paid 

Overall  quality  of  facilities  and  service 

Figure  2.  Range  and  mean  of  satisfaction  scores  associated  with  57  recreation  areas 
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CONCLUSIONS:  The  pilot  survey  results  were  generally  consistent  with  those  previously 
obtained  by  aggregating  results  from  independently  conducted  project-level  surveys.  Where 
differences  were  evident,  they  may  have  resulted  from  either  satisfaction  trends  or  changes  in 
wording  of  the  survey  instrument.  This  ambiguity  underscores  the  need  to  maintain  consistent 
methods  over  time  in  a  monitoring  program. 

Successful  completion  of  the  pilot  survey  demonstrates  the  logistic  feasibility  of  executing  a 
design  for  a  national  customer  satisfaction  monitoring  survey  with  voluntary  cooperation  from 
many  different  project  offices.  Where  they  are  provided  with  study  design  support,  it  is 
reasonable  to  expect  the  natural  resource  management  staff  at  different  projects  to  execute  their 
part  of  a  larger  plan  that  requires  adherence  to  a  pre-planned  sampling  schedule  and  standardized 
data  collection  methods.  But  because  survey  results  may  be  sensitive  to  any  changes  in  the 
survey  itself,  major  survey  components,  including  the  survey  instrument,  sampling  design,  and 
data  collection  protocols  should  be  available  in  final  form  before  initiating  a  monitoring  program 
and  changed  as  little  as  possible  thereafter. 

A  concern  arising  from  a  program  based  on  voluntary  participation  of  projects  is  the  potential 
effect  of  selective  non-participation  on  survey  results.  Of  the  30  percent  of  projects  that  were 
unable  to  participate  in  this  survey,  some  were  experiencing  flooding,  ongoing  rehabilitation  of 
recreation  facilities,  or  other  disruptions  to  recreation  that  might  be  expected  to  have  a 
downward  influence  on  satisfaction  scores.  This  could  result  in  a  tendency  to  overestimate 
overall  visitor  satisfaction  using  data  obtained  only  from  voluntary  project  participants. 

Many  of  the  projects  participating  in  the  survey  wanted  feedback  that  would  allow  them  to 
compare  satisfaction  at  their  project  with  that  of  other  projects.  The  strong  interest  of  project 
managers  in  using  customer  satisfaction  results  to  assess  their  own  performance  suggests  that 
a  program  for  self  evaluation  and  improvement  encompassing  a)  comparative  benchmarking, 
b)  identification  of  best-in-class  projects  and  recreations  areas,  and  c)  sharing  of  best  business 
practices  used  by  best-in-class  projects,  would  be  well  received  in  the  field. 

POINTS  OF  CONTACT:  For  additional  information  concerning  this  technical  note,  contact 
Mr.  Richard  L.  Kasul,  U.S.  Army  Engineer  Research  and  Development  Center,  Vicksburg,  MS 
(601-634-3921,  Richard.L.Kasul@erdc.iisace.army.mH),  or  the  manager  of  the  Recreation 
Management  Support  Program,  Mr.  Scott  Jackson  (601-634-2105,  Scott  Jackson@erdc. 
iisace.army.md).  This  technical  note  should  be  cited  as  follows: 

Kasul,  R.  L.,  Chang,  W-H,  and  Franco,  S.  F.  (2003).  “Feedback  from  Corps  of  Engineers 
recreation  visitors;  Results  of  a  2002  national  customer  satisfaction  survey,”  Natural 
Resources  Technical  Notes  Collection  (ERDC/NRTN-REC-14). 
http  ://\\>ww.  wey.  army,  mil/el 
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Appendix  A.  Example  of  the  Custom  Sampling  Schedule  Provided  to  Each  of  the 
Participating  Projects 
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Appendix  B.  Sampling  Instructions  Provided  to  Project  Personnel 


National  Customer  Satisfaction  Survey:  Instructions  for  Survey  Personnel 
Background 

Yours  is  one  of  20  projects  that  have  been  selected  at  random  to  provide  a  quota  of  120  completed  customer 
comment  cards  from  visitors  during  the  period  1  July  through  2  September  2002.  The  comment  cards  are  to  be 
completed  at  three  designated  recreation  areas.  These  areas  have  also  been  pre-selected  at  random  from  the 
recreation  areas  on  your  project. 

The  data  collected  on  your  project  will  be  combined  with  data  from  the  other  projects  to  produce  a  national 
estimate  of  customer  satisfaction  for  the  Corps  recreation  program.  The  national  estimate  of  customer 
satisfaction  is  one  of  the  performance  measures  of  the  Corps  recreation  program  that  will  be  reported  to  the 
Office  of  Management  and  Budget  (0MB)  as  required  under  the  Government  Performance  and  Results  Act 
(GPRA).  The  amount  of  data  you  collect  will  not  be  sufficient  nor  will  it  be  used  to  separately  evaluate  customer 
satisfaction  at  your  project. 

Task  Overview 

You  are  being  provided  with  a  supply  of  comment  cards,  a  calendar  showing  the  sampling  schedule,  and  the 
attached  Data  Collection  Guidelines  for  conducting  the  survey.  You  will  also  need  access  to  the  Data  Analysis 
Software  available  on  the  Corps  NRM  Gateway  at 

http://'corDslakes.iisace.armv.mil/einplovees.’Commentcard.''card.html. 

The  comment  cards  are  the  same  cards  you  have  been  using  for  the  past  several  years.  The  analysis  software  is 
the  same  software  you  have  been  using  to  enter  data  from  cards  to  an  electronic  data  file. 

The  customer  satisfaction  survey  should  be  completed  according  to  the  Data  Collection  Guidelines  described 
below.  This  survey  was  developed  around  a  rigorous  sampling  plan  that  will  allow  us  to  produce  a  national 
estimate  of  customer  satisfaction  with  minimal  data  requirements  from  any  one  project.  Our  ability  to  produce  a 
meaningful  national  estimate  of  customer  satisfaction  depends  on  adherence  to  the  Data  Collection  Guidelines  as 
closely  as  possible. 

As  you  complete  each  day  of  sampling,  record  on  the  calendar  the  number  of  surveys  completed  and  the  number 
of  visitors  who  refused  to  take  the  survey.  Also  keep  comment  cards  completed  in  connection  with  this  survey 
separate  from  comment  cards  you  might  collect  in  connection  with  any  other  survey  you  may  be  conducting. 

As  you  collect  completed  visitor  comment  cards,  enter  them  into  an  electronic  database  using  the  data  analysis 
software.  This  software  requires  that  you  insert  a  floppy  disk  on  which  the  electronic  dataset  will  be  stored.  If 
you  are  doing  other  comment  card  surveys,  please  use  a  separate  floppy  disk  when  entering  data  for  this  survey 
so  that  data  from  this  survey  will  not  be  intermingled  with  data  from  your  other  comment  card  surveys. 

Please  e-mail  the  completed  electronic  dataset  to  Sammv.F.Franco@wes02.usace.annv.mil.  Also  fax  the 
completed  calendar  notes  to  the  attention  of  Mr.  Sam  Franco  at  601-634-4242.  Dataset  and  calendar  notes 
should  be  completed  and  returned  not  later  than  15  September  2002. 
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Appendix  B  (cont’d).  Sampling  Instructions  Provided  to  Project  Personnel 


Data  Collection  Guidelines 

1 .  Refer  to  the  accompanying  calendar  to  identify  the  days  and  recreation  areas  that  have  been  randomly 
selected  for  sampling  at  your  project.  You  will  conduct  surveys  at  each  of  the  three  designated  recreation 
areas  on  five  different  days  throughout  the  summer. 

2.  Obtain  eight  completed  customer  satisfaction  surveys  for  each  designated  day  and  recreation  area  indicated 
on  the  calendar. 

3.  Recreation  areas  have  been  classified  into  one  of  four  types.  The  method  of  administering  surveys  to 
visitors  will  differ  for  each  type  of  recreation  area  as  follows: 

Campgrounds:  On  the  evening  of  the  designated  sampling  day,  check  with  the  gate  attendant  to  identify 
campers  that  are  scheduled  to  leave  the  following  day.  Visit  their  campsites  during  the  evening  and  obtain 
one  completed  survey  from  each  of  eight  camping  parties  who  are  scheduled  to  leave  the  next  day. 

Day-Use  Areas:  Obtain  eight  completed  surveys  distributed  over  as  much  of  the  day  as  is  practical.  Take 
advantage  of  routine  patrols  to  minimize  trips  to  the  recreation  area.  The  survey  should  be  administered  to 
visitors  who  show  signs  of  leaving  the  recreation  area.  Approach  visitors  in  the  parking  lot  or  at  their 
recreation  site  as  they  are  preparing  to  leave.  Traffic  stops  are  discouraged. 

Recreation  Areas  With  Separate  Camping  and  Day-Use  Sections:  On  the  designated  sampling  day, 
administer  four  surveys  in  the  camping  section  as  described  above  for  “Campgrounds”  and  four  surveys  in 
the  day-use  section  as  described  above  for  “Day-Use  Areas.” 

Campgrounds  That  Allow  Day-Use:  On  the  designated  sampling  day,  administer  four  surveys  to  camping 
visitors  as  described  above  for  “Campgrounds”  and  four  surveys  to  day-use  visitors  as  described  above  for 
“Day-Use  Areas.” 

4.  Comment  cards  should  be  filled  out  in  your  presence  and  returned  directly  to  you.  If  you  wish,  you  can  read 
the  choices  to  the  visitor  and  mark  the  card  yourself  Please  do  not  leave  the  comment  card  with  the  visitor 
with  instructions  to  drop  it  off  at  a  designated  location. 

5.  While  administering  surveys,  keep  track  of  both  the  number  of  completed  surveys  and  the  number  of  visitors 
who  refused  to  take  the  survey.  Record  both  totals  in  the  space  provided  on  the  calendar. 
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Appendix  B  (cont’d).  Sampling  Instructions  Provided  to  Project  Personnel 


Adjustments  for  Unforeseen  Circumstances: 

Extended  Closure  of  Recreation  Areas:  If  the  recreation  area  is  scheduled  to  be  closed  for  an  extended  period 
of  time  during  the  survey  period,  please  contact  Mr.  Sam  Franco  for  instructions. 

Short-term  Closure  of  Recreation  Areas:  If  the  recreation  area  is  closed  on  the  scheduled  sampling  date 
because  of  high  water  or  other  short-term  events  and  is  expected  to  reopen  in  the  next  couple  of  weeks,  then 
reschedule  the  missed  surveys  as  follows: 

•  If  the  missed  survey  was  originally  scheduled  for  a  weekday,  reschedule  it  for  the  first  available 
weekday  after  the  recreation  area  re-opens. 

•  If  the  missed  survey  was  originally  scheduled  for  a  weekend  day,  reschedule  it  for  the  first  available 
weekend  day  after  the  recreation  area  re-opens. 

Rain  days:  If  adverse  weather  conditions  keep  most  visitors  from  using  the  recreation  area  on  the  designated 
sampling  day,  then  reschedule  the  survey  for  that  recreation  area  as  follows: 

•  If  the  survey  was  originally  scheduled  for  a  weekday,  then  reschedule  it  for  the  next  available  weekday. 

•  If  the  survey  was  originally  scheduled  for  a  weekend  day,  then  reschedule  it  for  the  next  available 
weekend  day. 

Inability  to  fill  daily  quota:  If  there  are  too  few  visitors  available  on  the  scheduled  sampling  day  to  obtain  eight 
completed  surveys,  then  fill  out  the  remainder  of  the  quota  on  the  next  available  day  as  described  under  “Rain 
Days.” 

Other  unforeseen  circumstances:  Contact  Mr.  Sam  Franco  for  instructions. 

Point  of  Contact:  For  clarification  or  additional  information,  contact  Mr.  Sam  Franco  by  phone  at  601-634-4205 
or  by  e-mail  at  Sainrnv.F.Franco^erdc. usace.annv.ini 1. 
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